DOCUMENT RESUME 



ID 218 245 

AUTHOR , 
TITLE 



PUB DATE 
NOTE 



EDRS PRICE • 
DESCRIPTORS 



SP 020 374 



Diekhbff, George M.; Wigginton, Phil 
Using Multidimensional Scaling-Produced Cognitive 
Maps to Facilitate the Communication of Structural* 
Knowledge*. \ * 

Apr 82 . x • ^ ' 

12p.; Pap«r presented at the Annual Meeting of the 
Southwestern Psychological Association (Dallas, TX, 
April, 1982).. 

' MF01/PC01 Plus postage. * 
Classroom Techniques; Cluster Analysis; Cognitive. 
Measurement; 'Cognitive Style; 'Concept Teaching; 
Discussion (Teaching Technique); 'Multidimensional 
Scaling; Questioning Techniques; Teacher Education; 
'Teaching Methods 
IDENTIFIERS 'Cognitive Mapping 

ABSTRACT . • ~ ~ \ , 

In recent years, there has been' increasing interest 
in finding ways of promoting and evaluating structural knowledge 
(knowledge of how ideas ; events, and principles are interrelated). 
Research has demonstrated that students' numerical judgments of the 
strength of relatedness among ideas drawn from a domain provide 
insights into how they have organized their knowledge of that domain. 
When these judgments are analysed through multidimensional scaling, a 
graphic array can be generated -in which highly related ideas are 
grouped together and less related ideas are located farther apart. 
These graphic afrays arm called "cognitive maps" because they map out 
a student's understanding of the structural interrelationships that 
exist among ideas. The use of multidimensional peeling-produced 
cognitive maps provides a systematic nay of- presenting structural - 
knowledge which, because of the sequential nature of traditional 
lectures and texts, might not otherwise be presented at all. 
(Authors/FC) * 
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Abstract . 

- . * *: - ' 

In 'recent years there* has been Increasing interest in finding ways Qf promoting 
and evaluating Structural" knowledge; i.e., knowledge of how ideas, events, 
principles, etc. are interrelated. Research has demonstrate J that students)* 
numerical judgments of the strength of relatedness between ideas drawn from 
a domain "provide insights into how these students have organized or structured 
'their knowledge of that domain. When these judgments are analyzed through" 

• * 

multidimensional scaling, a graphi c« array . is generated. In which highly related 

\ 

ideas ate depicted as points located close together in space and less related 

» 

ideas are .located further apart. These graphic arrays are cal led 4, cogni ti ve 
maps" b^ause they map out a student's understanding of the Jtructural 
'interrelationships that exist between the ideas tha* were judged. Three 
studies are' discussed in this paper in which an instructor's relationship 
judgments were used in generating cognitive maps for ideas from introductory 
psychology history & system., and statistics. These maps w*r* then used 
in teaching (rather than assess fng) structural knowledge. Test scores 
obtained fVqm students taught using.cogni ti ve maps were superior to those of 
students taught In tradi tional ^aysT- The use of .multidimensional scaling- , 

v ■ • ' ; • 

produced cognitive maps provides S systematic wjy^of presenting structural/ 

knowledge which, because of the sefluential nature of tradi tiona.1 lectures .and 

' . * • . ' \ / 

texts, might not otherwise be presented at all. • 



Usinjj Multidimensional ScaVtng-Produced Cognitive Maps 
to Facilitate the Communication of Structural- Know fedge . 
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Although any statement of 'educational goal* can be argued,: it is 
certainly true that one of the immediate goals of classroom instructibn is • 
to communicate to students a knowledge, of both the meaning of individual . 
concepts and ay understanding of the ways in which th^se concepts are 
interrelated, ^This knowledge of relationships has been variously called' 
internal connectedness, integrative understanding, or structural knowledge, 

and It pay be aroued that it is an essential level of understanding, sjnce 

* t 
in many theories pfjong term memory structure*, the mining of any one 

. » * * * 
concept is given by Its pattern of relationships to other concepts in the / \ 

knowledge, structure. # v 

* ■ - 

It Is unfortunate,, then, that so few students emerge from our classrooms 
with any clear sense of structural understanding. It is even /tare disheaftening 
to observe that this Is usually the' consequence' hf our fatlut/3 to teach % - 



structural knowledge. Admittedly, teaching at the structural level is, 

* * 

* » * % • * -*^> 

difficult. The sequential nature of langqage means that lectures and texts 

• * * 
wl 11 necessari ly deal with first one Idea, then another and another. Rarely 

'are there opportunities to stop and Systematically explore the relationships 

' fi " 1 

<•# • - ■* 

that extet between ideas presented at different times and in different d 
contexts . 
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The research discussed here was conducted 'duriog the last two years 
* ^ 

at Midwestern State Unfversi ty to develop .and assess a method by which 
teachers may systematically (a) become more aware themselves of the * 
Structural interrelationships that exist among the concepts they teach, and 
(b) better commun i eft teVthis information to students, * - * 
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For several.* ye?.rs , various investigators (e.g % ; Diekhpff, in press; 

* ♦ 

Fenker, 1f>7S; Shpvelson, 197*: and. Welner ft Kaye, 197*0 have foujid ttjat 
when college students are glvenpairs of concepts (for example, 
REINFORCEMENT - PUNISHMENT, COGNITIVE* DISSONANCE - BALANCE THEORY, or * 
CLARK HULL - KURT LEW IN) with instructions to use a numeri qal- scale in rating' 
the degree o* similarity or relatedhess listing within each pair, their 
numerical judgments often provide useful informatron through which understanding 
at the structural level may b6 evaluated. Typically, the similarity between 
a student's judgment^ and those of his instructor as. well as the test- re test 
relf ability of a student's judgments have been shown to be significantly . e 
correlated with traditional measures of structural understanding, including 
essay tes,t scores.* Riven tftat a student's relationship judgments carry 
important information about structural knowledge, it follows that ah 
Instructor's judgments might provide a medium through which structural 



knowledge .could be conveyed tQ*s tudents . 

*4 



However, relationship judgments . in their raw form contain an enormous 
amount of Jnformatipn^ It is necessary to fyid a w^y to condens'e this ~ 
information into. a more palatable package. Multidimensional scaling analysis 
4 (MDS) provides an ideal means of reducing and summarizing the structural 
infopmati on contained within. a set of relatfonship judgments* 

Consider this step-by-step description j of how relationship judgments 

* « * 

for a set of concepts." taken from genera] psychology might be analyzed through 

HOS" analysii. . 

STEP 1 . A set of key concepts is selected from the domain being 
taught: INTELLIGENCE, GENETICS, REINfORCEMENT, PREJUDICE, NEUROSJS, ATTITUDES, 



PUNISHMENT, INK BLOT TESTS, and LANGUAGE. . * ' • \ ' 

STEP 2. AH possible pairs. of these concepts are formed and each 
pair is rated for relBtedness using a 1-fJ scale, with«1 representing 
4fttle qr no /elation&hip and 9 representing a strong relationship, Selationshi 
Judgments are converted to decimal *form 0.e.\ I becomes .1,,2 becomes ,2, etc) 
and r$ are inserted into the diagonal of the matrix i 
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Although the^ task of generating relationship judgments may . $eem fairly 

subjective and difficult, experts show goocf reliability in their judgments 

•■I , 
over time, and comparisons be tfoeen the judgments obtained from different 

experts typically show a high degree of similarity. Generating* relationship 

/udgnoftflts fs not an impossibly task, although it can become tedious if many 

■ * 

concept-pairs are Involved, V 



\ 

. ST - EP 3- The matrix of relationship judgments is next analyzed through 

* V 

pripcfpal components analysis as though the relationship judgments were 
correlatlons—vector-product multidimensional scaling (Nunnally, 1978). 
Although other variations of MDS^re available, we have, focus^ed* on vector- 
oroduct analysis as nearly all colleges and universities now have access 
to "canned" principle components /Ofialys is programs (e.g., SPSS), 

, This analysis esserttiafty^trans fates relationship judgments into 

distances, sd that' highly related, concepts are seen as being close together 

i x • ; 

in space and unrelated concepts Are further "apart. This pattern of 



distances ,' then, can be used in creating £ graphic array of concept-points 
1n space, sometimes called a "cognitive map* 11 / , • 4 
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Onee a cognitive map is generated i q t this ^fashi on, i t provides a 

graphic synopsis of thte structural interrelationships that, exist among „ 

#* ♦ . i • 

the ciJftcepts used in generating the n*ap. Such a map can be used as the 

focus of cl ass roc^n discussions that necessarily fop us on structural 

relations-hips. For example, why are some, concepts clustered tightly 

tooether? Vhy are some concepts, in dl f ferent s cl us ters? X/hy, are some 

clusters" closer together thar^ others'? How can the various clusters be 

1 i nked toqether or related? ' * 

» 

Haps' of this sort have been used successfully in undergraduate general 

0 

psychology where 50-mfnute in-class discuss ions of • the instructor's # 

maps yielded* iqni ffcantly higher essay test scores than were obtained 

from students who were not exposed to the maps (Diekhoff £ Diekhoff, .1982), 

In a class coverinq history and systems of , psychology as well, name? of 

famoui figures in the history of psychology were, subs ti tu ted for the concepts 

used in the precedinq example to produce maps^like the one shown belcw (Diekhoff, 

/ : - 
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In-class discussions these maps forces structural- level thinking 

that would be^drffTcult to accompl i otherwi se. The following comments 

illustrate those that typical ly' emerge during -s^ch discussions. Clus*t4r 1 

contains the names of those of a mental istic orientation whose contributions 

are still redognized as important and valid. Those in Cluster Z all-were ' 

Evolved in early attempts to destribe the physiological bases of behavior 

and mental processes. Cluster 3 contains the names of those who offered 

nonphysiological M false starts 11 to psychology, Galtoft falls between Clusters 

1 and 3» reflecting the f ,fact thngt while he introduced the Mmpo^tant ideas of * 

mental measurement o and correlation (Cluster 1), he mistakenly attempted to • 

use sensory and motor measures of intelligence (Cluster 3). $ 

* • * 

Although cognitive maps have proven useful in enhancing the % * 

communication of structural information to students, Phi l s Wiggf nton and, I 

have used HDS in a slightly different way to teach the concepts of statistics * 

tq psychology students. The process begins as always with the selection of 

concepts to be judgecNfor relatejdness. Relationship judgments are 

generated for all possible pairs of these concepts and the judgment matrix x • 

is analyzed through princioal components analysis. Howeve/-, instead of « 

centering discussions around a cognitive map produced from one such priheipal 

v, 

components analysis, we run a series of analyses. The. fi rst. extracts only 

• * * 

two principal components , the next, three, arfd so on until the concept clusters 

- 

that comprise each principal component are no longer interpretable. 

The first two principal components represent very general conceptual ' 
categories. Extra£tion <*f the third principal component causes one of the 
first two categories to break down into^two somewhat narrower categories. The 



fourth principal component results j^n a similar breakdown-o f one of the 

g , 

..-previous categories, and so forth. 

As. an example, consider t^he concep^ heirarchy Shbwn below. Beginning 
y/s th two very general concept cluslfers, each successive analys is^ creates another, 
more soecific level of the heirarchy, t 

TE*STAT!ST^CS 
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Scajfterplots 4 
Construct Validity 
Predictive Validity * 
Reliability 
Correlat*on 

Non-linear Relationships 
Differencial Validity 
Causa 1 Relat lonsh i ps 
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UNIVAR IATE STATISTICS 

Frequency Distributions 

Skewntfss 

Percent! les 

Mean , 

Mediarr 

Range 

Variance . 
Standard Deviation , 
Standard Scores 
Standard Normal Curye m 
Normal Distribution 
Probfifci lity 



BIVARtATE ST ATISTICS 
Same as above 



DESCRI'PTIV^STATISTICS STD, NORMAL PI ST , 

Frequency Distribution Pe'rcentile 

Skewnfcss - Std. # Score 

Mean * Std/ Norma V Curve 

Median ** Normal Distribution 

Range Probabi 1 i ty 
Variance 

Standard Deviation 



BIVARIATE STATISTICS CENTRAL TENDENCY . Dl SPERSJOff STfr. NORMAL PI ST, 



Same as above 
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Skewness 
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Median 
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Range 
Variance 
Std, deviation 
Std. Score. 



Same as above 



PSYCHOMETRICS, 

Construct Valid! ty 
Predictive Validity 
Reliability 
Differential Validity 



CORRELATION CENTRAL TENDENCY ' DISPERSION STD, NORMAL PI ST, 



Scatterplot ' 
Correlation 
Non-1 inear Rel . 
Causal Re1 . 



Same as above Same as above Same as above 
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A pilot S(tudy in which small groups of students were led through 
discussions pf concept hei rarchies like^this one- indi cated that the 
discussions were effective in getting students to think abqut structural . 
interrelationships in statistics and boosted scores on tests designed to 
tap this kind of, knowledge . # 

1 ' ( 

In conclusion* cognitive maps and concept he! rarrchies produced through 
multidimensional scaling of an instructor 1 ^ relationship judgments are 
potentially valuable instructional tools. StMl coming are mare 
rigorous t,es its 'of their effectiveness. 
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